MESH PATTERNS WITH SUPERFLUOUS MESH 
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Abstract. Mesh patterns are a generalization of classical permutation patterns that en- 
compass classical, bivincular, Bruhat-restricted patterns, and some barred patterns. In this 
paper, we describe all mesh patterns whose avoidance is coincident with classical avoidance, 
in a sense declaring that the additional data of a mesh was unnecessary for these patterns. 
We also describe the permutations having the fewest superfluous meshes, and the permuta- 
tions having the most, enumerating the superfluous meshes in each case. 
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1. Introduction 

Mesh patterns were introduced by Branden and Claesson in [4J to generalize many existing 
varieties of permutation patterns, including classical patterns (brought to prominence in 
[6]), vincular patterns (see [21 E]), bivincular patterns (introduced in Bruhat-restricted 
patterns ([12]), and certain cases of barred patterns (introduced in [11]). There has also 
subsequently been an additional generalization by Ulfarsson, to marked mesh patterns [10]. 

A mesh pattern (defined precisely in Section |2]) involves both a classical permutation and 
a region in the plane known as the "mesh." In certain cases, the information contained in 
this mesh turns out to be unnecessary. For example, the mesh pattern 



;i23,{(i,i)}) 



is avoided (respectively, contained) by exactly the same permutations as those avoiding (re- 
spectively, containing) the classical pattern 123. 

In this paper we characterize all mesh patterns in which the mesh is superfluous in this 
way, answering a question of Kitaev. This result. Theorem 13. 5[ states that a mesh pattern 
has this property if and only if it has no configurations of the form depicted in Figure [TJ 

The proof of the main result is given in Section HI and the paper concludes with some 
related enumerative results for extremal cases of superfluous meshes. 

2. Classical and mesh patterns 

We will use the word permutation to refer to an automorphism of the set [A;] = {1, . . . , A;} for 
some positive integer k, and will say that two sequences of real numbers are order isomorphic if 
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they are in the same relative order, denoted We let &k denote the set of all permutations 
of [A;]. 

Example 2.1. -1 ^ 3 1 2. 

A permutation n G &k can be written in one-line notation as the word 7r(l) ■ ■ ■ 7r(A;). 
Classical pattern containment and avoidance are defined in terms of this notation. 

Definition 2.2. Given permutations tc G &k and a G ©„, where k < n, we saw that a 
contains a vr-pattern if there exist indices ii <■■■< ik so that 

a{ii)a{i2) ■ ■ ■ (r{ik) ~ t^- 

If there are no such indices, than a avoids the pattern tt. 

Example 2.3. 

• The permutation 42135 contains the pattern 213 in five ways: 

425 ^ 415 ^ 435 ^ 213 ^ 215. 

• The permutation 42315 avoids the pattern 132. 

We can also represent a permutation tt G &k graphically, as 

^(Tr) = {(z, 7r(i)) : 1 < i < A;} C [1, A;] X [1, k]. 
This will be useful when discussing mesh patterns below. 
Example 2.4. 



^(42135) = 



To say that a contains a vr-pattern means that G{(j) contains at least one copy of the graph 
G(7r). 

Example 2.5. 

• The graph G(42135) depicted in Example 12.41 contains 



^(213) = — 



in five ways. The copy of G(213) that corresponds to the occurrence 425 is 



































1 — 










— 1 






















— 1 


1 — 







MESH PATTERNS WITH SUPERFLUOUS MESH 



3 



The graph depicted in Example 12.41 does not contain any copies of 



^(132) 



In [1], Branden and Claesson introduced a new type of permutation patterns, called "mesh 
patterns." These include, as special cases, all classical, (bi)vincular, and Bruhat-restricted 
patterns, as well as certain barred patterns. 

Definition 2.6. A mesh pattern is an ordered pair {t[,R), where vr G &k is a permutation, 
and i? is a subset of the + 1)^ unit squares in [0, /c + 1] x [0, A; + 1], indexed by their lower-left 
corners. The set R will be called the mesh of the mesh pattern. Mesh patterns are depicted 
by drawing G{n) and shading all squares in the mesh R. 



Example 2.7. 



(213,{(0,3),(1,2),(1,3),(3,0)}) 



Definition 2.8. A permutation a contains a mesh pattern (tt, R) if G{a) contains a copy 
of ^(Tr) (that is, there is an occurrence of vr in a) such that the regions of G(7r) which get 
shaded in the mesh corresponded to regions in the graph of a that contain no points of G{a). 

Example 2.9. The permutation 42135 contained the pattern 213 in five ways. This same 
permutation contains the mesh pattern (213, {(0, 3), (1, 2), (1, 3), (3, 0)}) in only four ways, 
depicted below. We use thick lines in this example to clarify how the four elements in the 
mesh appear in each picture. For example, (1,2) G R describes the region whose horizontal 
coordinates are between the first and second symbols in the 213-pattern, and whose vertical 
coordinates are between the first and third symbols in the 213-pattern. 
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The remaining occurrence of 213 in 42135 does not obey the restrictions of the mesh because 
the shaded region includes an element of ^(42135), as shown in the following diagram. 
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In this paper, we are concerned with which permutations contain or avoid a given pattern. 
To this end, we define two sets. 

Definition 2.10. For a (classical or mesh) pattern p, let Av{p) be the set of permutations 
that avoid p, and let Cont(]5) be the set of permutations that contain p. Similarly, if P is any 
collection of patterns, then 

Av(P) = Pi Av(p), and 

peP 

Cont(F) = y Cont(p). 

pGP 

The following fact is obvious for any set P of patterns: 
(1) |j6„ = Av(P)UCont(P). 

n 

3. Main results 

Kitaev asked which mesh patterns could be equivalently described by classical patterns. 
That is, we want to know for which mesh patterns (vr, R) there exists a set 8(71, R) of classical 
patterns so that 

Av((7r,i?)) =Av{Si7i,R)). 
By equation ([T]), this property can be equivalently stated as 

Cont((7r,i?)) = Cont{S{7r,R)). 

Throughout this paper, we will assume that the set S'(7r,i?), when it exists, is of minimal 
cardinality. More precisely, if a is contained in r, then Ay {{a, r}) = Av({cr}). Thus it suffices 
to consider just {a} when discussing avoidance and containment of {cr, r}. 

The possibility of different types of patterns characterizing the same sets of permutations 
has arisen before, and was the subject of a recent paper comparing barred and vincular 
avoidance We will expand upon the language of that paper here. 

Definition 3.1. Suppose that P and P' are two sets of permutation patterns. If Av(P) = 
Av(P'), then P and P' are coincident. If P = {p}, then we may say that p and P' are 
coincident. 

Recall that P and P' are Wilf-equivalent if |Av(P) fl 6„| = |Av(F') fl 6n| for all n. Thus 
coincidence is stronger than Wilf-equivalence because coincidence requires that the sets Av(P) 
and Av(P') themselves coincide. 

Observe that the complement to Kitaev's question is entirely straightforward to answer. 

Lemma 3.2. Every classical permutation ir is coincident to the mesh pattern (7r,0). 

In order to answer Kitaev's question, we will need to introduce an additional piece of 
terminology. 

Definition 3.3. Let (vr, R) be a mesh pattern. An unbalanced diagonal is a configuration in 
(tt, R) having one of the forms depicted in Figure [1] 
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Figure 1. Unbalanced diagonals in a mesh pattern (tt, R). A point is in ^(Tr) 
if and only if it is marked •. 



Example 3.4. The mesh pattern (231, {(1, 1), (2, 0), (3, 1)}) depicted by 



has exactly one unbalanced diagonal, and it is formed by {(2, 0), (3, 1)} C and 7r(3) = 1. 

Note that when the configurations in Figure [1] consist of a single square, this means that 
there is an (z, j) G R with {7r(i), 7r(i + 1)} fl {j, j + 1} = 0. In other words, the shaded square 
with lower-left corner must look like the square drawn below, where again a point is in 
^(Tr) if and only if it is marked •. 



(2) L 

To put this another way, for a square E R to not, itself, be an unbalanced diagonal, it 
must have one of the following forms. 

c n □ o n n 

These are the only possibilities because vr is a permutation, and so G{n) contains exactly one 
element along each column and along each row. 

We are now able to state the main result of this paper. 

Theorem 3.5. A mesh pattern (vr, R) is coincident to a set S{tc, R) of classical patterns if 
and only if{7c,R) has no unbalanced diagonals. Moreover, if{Tc,R) satisfies this requirement, 
then in fact S{tc, R) = {tt}, and so (tt, R) is coincident to n. 

Example 3.6. 

• The mesh pattern (231, {(1, 1)}) depicted by 



is coincident to the permutation 231. 
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• The mesh pattern (231, {(1, 1), (3, 2)}) depicted by 



is not coincident to any set of classical patterns because {(3, 2)} G R is an unbalanced 



• The mesh pattern (231, {(1, 1), (2,0), (3, 1)}) of Example 13.41 is not coincident to any 
set of classical patterns because of its unbalanced diagonal. 

In light of the last statement of Theorem 13.51 we introduce the following terminology. 

Definition 3.7. If a mesh pattern (vr, R) is coincident to the classical pattern tt, then the 
mesh R is superfluous. 

Thus Theorem 13.51 could be rephrased as follows. 

Theorem 13. 5f . A mesh pattern has a superfluous mesh if and only if it has no unbalanced 
diagonals. 

One application of Theorem 13.51 recovers a result about so-called "boxed" mesh patterns 
from [T]. 

Corollary 3.8 ([H Proposition 1]). The only permutations of k letters for which [1, A; — 1] x 
[1, k — 1] is a superfluous mesh are 1, 12, 21, 132, 213, 231, and 312. 

Proof. Suppose that tt G &k is a permutation for which [1, A; — 1] x [1, A; — 1] is a superfluous 
mesh. Given ([2]), and the fact that tt is a bijection on [k], we can conclude that k < 4. 

If A; = 4, then it is easy to see that there will always be at least one square in the mesh 
that looks like ([2]), such as the darkly shaded square indicated below, yielding an unbalanced 
diagonal. 



The permutations with A; < 3 can each be checked by hand, and exactly two of these have an 
unbalanced diagonal, marked below with darkly shaded squares. 



diagonal. 




□ 
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4. Proof of Theorem 13.51 

The main result of this paper can be proved in three steps, which we break into propositions 
below. The first of these will prove the final sentence in the statement of the theorem. 

Proposition 4.1. // a mesh pattern (vr, R) is coincident to a set S{n, R) of classical patterns, 
then S{7i, R) = {n}. 

Proof. Because tt is the unique element of Cont((7r, R)) using the fewest letters, we must have 
TV e S{7r,R). 

Suppose there is some other element cr e S{7r,R) \ {tt}. By the minimality of |S'(7r,_R)|, 
we can assume that a does not contain a vr-pattern. However, because a e Cont(S'(7r, i?)) = 
Cont((7r, R)), we must have that vr is contained in a after all, obtaining a contradiction. □ 

We now address the biconditional statement of Theorem 13.51 The first direction of this is 
below. 

Proposition 4.2. // a mesh pattern {tt, R) has an unbalanced diagonal, then its mesh R is 
not superfluous. 

Proof. Suppose that the mesh pattern (tt, R) has an unbalanced diagonal. Then, without loss 
of generality, there exists h > 1 such that 

{{i + X, j + x) : < X < h} C R, 

ir{i + x) = j + X for all 1 < x < h, and 

7v{i) 7^ j and 7r(z + h) ^ j + h. 

Consider the permutation a that is order isomorphic to 

7r(l) ■ ■ • Ti{i) (j + .5) Tx{i + 1) 7r(2 + 2) ■ ■ • , 

formed by inserting j + .5 between the zth and {i + l)st symbols in tt. 

By construction, a G Cont(7r). In fact, a contains h + 1 occurrences of tt — obtained 
by choosing which of {cr(z + 1), a{i + 2), . . . , a{i + h + 1)} should play the roles of {n^i + 
l),7r(i + 2), . . . ,7r(« + h)} in the pattern. However, none of these occurrences of vr can be 
drawn so as to avoid all of the h + 1 shaded boxes in the unbalanced diagonal of (vr, R). Thus 
a ^ Cont((7r,/?)). 

Hence Cont((7r, i?)) ^ Cont(7r), and so {iv^R) and tt are not coincident. In other words, 
the mesh R is not superfiuous. □ 

There is now one piece remaining in the proof of Theorem 13.51 

Proposition 4.3. // a mesh pattern (tt, R) does not have a superfluous mesh, then it has an 
unbalanced diagonal. 

Proof. Suppose that the mesh pattern (vr, R) is not coincident to tt. Certainly Cont((7r, R)) C 
Cont(7r), so consider some a G Cont(7r) \ Cont((7r, i?)). By construction, this a has at least 
one occurrence of the pattern tt, and no occurrence of vr in cr avoids all of the shaded regions 
from the mesh R. 

Given an occurrence (tt) of vr in a, let ((7r),i?)o- denote the number of elements of G{a) 
that land in the shaded regions from the mesh R relative to this (tt) . 
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Now choose an occurrence (tt) for which ((vr), i?)^- is minimal, and let € R correspond 
to a shaded region that contains some {z,a{z)) G G{a). Note that because {z,a{z)) lies in a 
shaded region of this occurrence of the mesh pattern, we necessarily have that a{z) itself is 
not part of (vr). 

If this G i? is itself in an unbalanced diagonal in (tt, R), then we are done. 
Otherwise, without loss of generality, there exists h > 1 such that 

{{i + X, j + x) : < X < h} C R, 
{i + h,j + h) ^ R, and 
(3) n{i + x) = j + X for all 1 < x < h. 

For all 1 < X < h, let a{lx) represent n{i + x) in the occurrence (tt), and note from 
equation that 7r(i + l),7r(i + 2), . . . , 7r(i + h) are consecutive increasing values in the 
pattern. This means that a{li), a{l2), • • • , (j{lh) are increasing values in cr, and that no values 
in the occurrence (tt) are strictly between a{lx) and a{lx+i) for any 1 < x < h. 

Now define (vr)' from (tt) by replacing {a{li), . . . ,a{lh)} with {a{z),a{li), . . . ,a{lh^i)}, 
and not changing any other elements of the pattern. By construction, this (vr)' is another 
occurrence of tt in a. Also, in the diagram G{a), the shaded regions from the mesh change 
as follows, where a point in G{a) is filled in if and only if it is part of the pattern occurrence, 
and a region is shaded if and only if it is shaded by the mesh R. 



o 







o 

1 '■ — 




1 1 






»- 


» 




1 







This yields 

((7r)',/2)^<((7r),i?),, 

which contradicts the minimality assumption of {{7c),R)„. Thus must have been part 
of an unbalanced diagonal. □ 



5. Extremal enumeration 

Given a permutation vr, it is not difficult to enumerate the mesh patterns (tt, R) for which 
the mesh R is superfluous. This is because, by Theorem 13. 5[ we must simply choose an R 
that has no unbalanced diagonals. 

Definition 5.1. Given a permutation vr, let sup-mesh(7r) be the number of meshes that are 
superfluous for tt. 

To calculate sup-meshfor a given permutation, we can use the inclusion-exclusion principle. 
From there, it is also straightforward to enumerate the meshes that are not superfluous for 
some IT E &k, because these are all the remaining subsets of [0, A;] x [0, k]: 2^*^+^-' — sup-mesh(7r). 
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Example 5.2. Consider 123 G 63. Because any square of the form depicted in ([2]) would 
itself constitute an unbalanced diagonal, each in a superfluous mesh for 123 must satisfy 
|z — j| < 1. The squares satisfying this requirement are shaded below. 
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With this restriction in place, the only other unbalanced diagonals to worry about are the 
following four possibilities. 



We now use inclusion-exclusion to count the superfluous meshes for 123: 



sup-mesh(123) 



405. 



(26 + 2* + 2^ + 2^) + (2^ + 2^ + 2^ + 2*^ + 2^ + 2^) 
(22 + 2^ + 2^ + 2^) + 2° 



Example 5.3. Consider 132 G ©3. As in the previous example, the only possible squares 
that can be shaded by a superfluous mesh for 132 are indicated below. 



There are flve other unbalanced diagonals that we must also avoid. 




Thus 



sup-mesh(132) 



2I1 - (2^ + 29 + 2^ + 2^ + 2^) 

+ (2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^) 
- (2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^ + 2^) 
+ (2^ + 2^ + 22 + 2^ + 2^) - 2° 
= 576. 

From these examples, it is clear how to flnd those permutations that have the fewest and 
the most superfluous meshes. These extremes can be achieved by looking at how two different 
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configurations 



in ^(Tr) can overlap; in other words, by looking at when \TT{i) — n{i + 1)| = 1. 

Corollary 5.4. Suppose vr G (5^. 

(a) sup-mesh (vr) is minimized if and only if \TT{i) — n{i + 1)| = 1 for alll < i < k; that is, 
if and only if n = 123 ■■■ k or n = k ■■ - 321. 

(b) sup-mesh(7r) is maximized if and only if |7r(z) — n{i + 1)\ ^ 1 for all 1 < i < k; that 
is, there are maximally many (Ak) unbalanced diagonals to avoid. 

Proof. This result relies on the fact that if |7r(2) — n{i + 1)| equals 1, then there will be fewer 
superfluous meshes possible than if |7r(z) — 7r{i + 1)| does not equal 1. 

To see why this is the case, suppose that 7r(i) is the /th in a sequence of increasing con- 
secutive values in vr, and the Dth in a sequence of decreasing consecutive values in vr, where 
certainly mm{I,D} = 1. More precisely, 

n{i - 1) = - 1, 7T{i - 2) = 7r(z) - 2, . . . , 7r(z - / + 1) = n{i) - / + 1, 

and 

n{i - 1) = n{i) + 1, 7r(i - 2) = + 2, . . . , 7r{i - D + 1) = 7r(i) + D - 1. 

Similarly, suppose that 7r(i -|- 1) is first in a sequence of /' increasing consecutive values in tt, 
and first in a sequence of D' decreasing consecutive values in tt, where again min{/', D'} = 1. 

If 7r(z) — 7r(i-|- 1) = 1, then {{i, 7r{i)) , {i + 1, 7r{i + 1))} G G^tt) could belong to three possible 
unbalanced diagonals: one with / -|- 1 shaded squares, one with I' + 1 shaded squares, and 
one with D + D' + 1 shaded squares. The case of n{i + 1) — 7r{i) = 1 is analogous. On the 
other hand, if |7r(2) — 7r{i -|- 1)| 7^ 1, then there are four unbalanced diagonals to avoid: one 
with / -|- 1 shaded squares, one with D + 1 shaded squares, one with I' + 1 shaded squares, 
and one with D' + 1 shaded squares. 

Now, for each case, count the superfluous meshes involving the squares along these diag- 
onals. The difference between this number in the latter situation and this number in the 
former is 

2/+/'+-D+D'+4 _ ^2^+r+D+3 _^ 2^+^'+-°'+3 _^ 2^+^+-°'+^ + 2^'+^+-°'+3) 

+ {2^^^'^^ + 2^^+-°+^ + 2^^+-°'+^ + 2^'+-^+2 -I- 2^'+-^'+2 _^ 2^+^'+^) 

- (2^+1 + 2^'+i + 2^+1 + 2^'+i) + 2°" 

2l+I'+D+D'+3 _ |^2^+-f'+2 _|_ 2l+D+D'+2 _^ 2^'+^+^'+"^^ + (2^+^ + 2^'+^ + 2^+-^'+^) — 2° 

= 2(2^+^ - l)(2^'+i - 1)(2^ - 1)(2^' - 1) 
> 0. 

□ 

The permutations characterized in Corollary 15.4( b) can also be described as avoiding the 
so-called 1-box pattern, as discussed in [5] . Additionally, these permutations are enumerated 
by sequence A002464 of [?]. 
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Applying the same counting techniques as in Examples 15.21 and 15.31 we can enumerate the 
superfluous meshes for each extremal case described in Corollary 15.41 

Corollary 5.5. Fix a positive integer k. Then 

fc+i 



min sup-meshW = X:(-l)-((^! + Q2»«-) 

where (^) = for a < or b < a, and 

max sup-mesh(7r) = 



2k 



7r66fe ^ V I 

1=0 



Proof. In the first case, where the permutation is either 123- ■ - k or k - ■ -321, there will be 
3k + 1 potential elements of a superfluous mesh. These possible squares can be partitioned 
into + 1 unbalanced diagonals that need to be avoided: one of length k + 1, and k of length 
2. The following picture gives an example of this partition, with the arrows indicating the 
(hazardous) unbalanced diagonals. 



The result follows from a calculation as in Examples 15.21 and 15.31 

The only difference in the second case is that now there are 4k potential elements of a 
superfluous mesh, and these can be partitioned into 2k unbalanced diagonals of length 2 that 
must be avoided. The following picture gives an example of this partition, and again the 
arrows indicate the (hazardous) unbalanced diagonals. 



□ 
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